Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | See parent post | Go Back
View Post [edit]

Poster: micah6vs8 Date: Sep 10, 2011 11:15am
Forum: web Subject: Re: Why is Archived content purged retroactively? [Was: Re: Ezboard content suddenly not available in the new system - why?]

That's quite a thought, but I don't have the decoder ring. I'm kinda, sorta hoping that media will not be deleted on the archive. Isn't that the point of Internet Archive?

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffJeff Kaplan Date: Sep 12, 2011 10:35pm
Forum: web Subject: Re: Why is Archived content purged retroactively? [Was: Re: Ezboard content suddenly not available in the new system - why?]

My understanding is that when a robots.txt is in place all pages from that site are blocked.

This post was modified by Jeff Kaplan on 2011-09-13 05:35:15

Reply to this post
Reply [edit]

Poster: jory2 Date: Sep 10, 2011 1:55pm
Forum: web Subject: Re: Why is Archived content purged retroactively? [Was: Re: Ezboard content suddenly not available in the new system - why?]

Jeff, MissTheOldOne was asking what a few other people have been asking for sometime now.
'Why are so many domains being "blocked" and "excluded" from the wayback machine?'
Reading the comments posted in the forums, most people have concluded the reason is because of "Domain Resellers" placing robot.txt files on recently acquired domains.
This can be the case with some domains; there is also the possibility that website owners themselves contacted the Internet Archive to have their property removed.
Jeff if the latter is the case wouldn't the Internet Archive be legally obligated to remove and delete all infringing media and material's from it's website and
data storage.
How would the Internet Archive be within it's legal rights to retain a person's illegally acquired property, and simply "block" and make "unavailable" any media and material proven to infringe on someone's copyrights.
Unless the laws are different solely for the Internet Archive?

Reply to this post
Reply [edit]

Poster: mystylplx Date: Nov 5, 2011 8:08pm
Forum: web Subject: Re: Why is Archived content purged retroactively? [Was: Re: Ezboard content suddenly not available in the new system - why?]

This seems a bit silly to me. For there to be any risk to your company the new owners would have to sue you for copyright violation. For them to sue over material produced not by them, but by a different entity who merely happened to previously own the domain name, is absurd in the extreme. It would be laughed out of court. More likely it would never go to court because the judge would dismiss it sua sponte. More likely still is they'll never sue because they aren't idiots...

Nevertheless, when I checked today robots.txt it only says--

"User-agent: *
Crawl-delay: 10

User-agent: MJ12bot
Disallow: /"

So when will the ezboard content be back up?

Reply to this post
Reply [edit]

Poster: mystylplx Date: Nov 5, 2011 8:20pm
Forum: web Subject: Re: Why is Archived content purged retroactively? [Was: Re: Ezboard content suddenly not available in the new system - why?]

Clarification on the above--

By "new owners" I referred to the new owners of the ezboard domain.

Reply to this post
Reply [edit]

Poster: micah6vs8 Date: Sep 12, 2011 5:34pm
Forum: web Subject: Re: Why is Archived content purged retroactively? [Was: Re: Ezboard content suddenly not available in the new system - why?]

Jeff, I am a bit in the dark and also more than a little out of my depth on this subject, but why did you remove your answer to me?
Baring a black swan event or apocalypse, I just wanted to know that IA will preserve the media, even these posts, placed here. I was reassured by your answer, but now it is gone. You can access my email (I assume, please let me know if this is not the case), so either here or off line could you please respond to my querry. If legal issues are not in play I would prefer an answer here. Thanks Jeff.

Reply to this post
Reply [edit]

Poster: jory2 Date: Sep 12, 2011 5:15pm
Forum: web Subject: Re: Why is Archived content purged retroactively? [Was: Re: Ezboard content suddenly not available in the new system - why?]

Its a good thing I printed your post Jeff, it's already been documented and sent to my lawyer.
You deleted it too late.

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffJeff Kaplan Date: Sep 12, 2011 10:38pm
Forum: web Subject: Re: Why is Archived content purged retroactively? [Was: Re: Ezboard content suddenly not available in the new system - why?]

i was referring to questions regarding robots.txt blocking site. i revised it to better state that. sorry if you misunderstood.

This post was modified by Jeff Kaplan on 2011-09-13 05:38:20

Reply to this post
Reply [edit]

Poster: jory2 Date: Sep 13, 2011 6:33am
Forum: web Subject: Re: Why is Archived content purged retroactively? [Was: Re: Ezboard content suddenly not available in the new system - why?]

Jeff you wrote the following:
"media is not being deleted. it just becomes unavailable for viewing in the Wayback Machine."
there was nothing to "misunderstand" about that.
Changing your post to read:
"My understanding is that when a robots.txt is in place all pages from that site are blocked." is pointing out the obvious and answers no ones questions.
We already know that sites are "blocked" when a robot.txt is respected, the questions is, is the content deleted from the Internet Archive, or simply made unavailable for public viewing?